Small-world hypergraphs on a bond-disordered Bethe lattice 
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We study the thermodynamic properties of spin systems with bond-disorder on smaU- world hyper- 
graphs, obtained by superimposing a one-dimensional Ising chain onto a random Bethe graph with 
p-spin interactions. Using transfer-matrix techniques, we derive fixed-point equations describing the 
relevant order parameters and the free energy, both in the replica symmetric and one step replica 
symmetry breaking approximation. We determine the static and dynamic ferromagnetic transition 
and the spinglass transition within replica symmetry for all temperatures, and demonstrate correc- 
tions to these results when one step replica symmetry breaking is taken into account. The results 
obtained are in agreement with Monte-Carlo simulations. 

PACS numbers: 64.60.Cn, 05.20.-y, 89.75.-k 



I. INTRODUCTION 



Many real-world systems and applications under 
scrutiny these days require random diluted graphs to 
model the interactions. These graphs often are of a bi- 
partite nature, separating the interactions from the vari- 
ables in the model, and hence allowing for more complex 
schemes of interactions. A simple, and much used, exam- 
ple of this type of graphs is the finitely connected random 
graph with p-spin Ising-like interactions. Such graphs are 
succesfully employed in the description and analysis of 
error correctingcodes (e.g. the low density parity check 
codes, seejl[ - 0), satisfiability problems (e.g. the k-sat 
problern, Q ) , modelling of structural glasses and spin- 
glasses Q, proteomic networks Q, etc. 
Some of these systems, however, require not only long- 
range interactions to effectively describe the system, but 
moreover possess local structures. There is a notion of 
neighborhood or distance between spins, and spins that 
are close have additional interactions of another type 
than the long-range ones. It is in this context that 
small-world networks have been developed, to provide 
a simple model that combines both long-range interac- 
tions with local interactions. One such small-world net- 
work to which a lot of work has already been devoted 
(see |6|] and references therein) is the random graph sup- 
plemented with a one-dimensional chain connecting all 
spins together, yielding the most simple notion of neigh- 
borhood: nearest-neighbor interactions. 
In this work we study the thermodynamic properties 
of such a small-world graph, composed of a finite and 
constant number of p-spin interactions (a p-spin Bethe- 
lattice) and a one-dimensional chain interconnecting all 
spins. We calculate the self-consistent equations govern- 
ing the statics of the system by employing transfer-matrix 
techniques, and solve these equations in the replica sym- 
metric (RS) approximation to determine the spinglass 
transition and the static and dynamic ferromagnetic 



transitions as function of the system parameters. We 
focus especially on the influence of bond-disorder. The 
corresponding phase diagrams show reentrance effects, 
indicating replica symmetry breaking (RSB), and we ap- 
ply one-step replica symmetry breaking (IRSB) in the 
reentrance regions. The results obtained are compared 
with Monte-Carlo simulations. This paper extends our 
earlier work (see [ll| ) , where we used analogous methods 
to study a small- world graph with poisson-distributed in- 
teractions. However, in that paper we did not consider 
bond-disorder and only discussed the RS ferromagnetic 
results. 

This paper is organized as follows. In Sec. |TT] we de- 
fine the small-world model. In Sec. IIIII we derive the 
saddle-point equations, and apply transfer matrix tech- 
niques to obtain the eigenvector equations determining 
the order parameter functions. In Sec. |IV]we solve these 
eigenvector equations in the RS approximation, leading 
to self-consistent equations for the order parameter func- 
tions. Sec. FVl discusses the analog IRSB equations. The 
RS and IRSB results are presented in Sec. IVI Al and 
Sec. IVIBI Finally, Sec. IVIII presents some concluding 
remarks. 



II. THE MODEL 

Consider a spin system of N Ising spins cr = 
(cti, . . . , <jn), Oi € {—1,1}, arranged on a Bethe lattice 
with p-spin interactions, and interconnected with a one- 
dimensional chain. The Hamiltonian is given by 



H{cr) = -y^o-,fej((T), 



(1) 
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The connection strengths for the longe range p-spin in- 
teractions J,-, i are taken from the distribution 



P{Jn...jp)^bSiJ,,...,^-J) + il-b)S{J,,...,^+J), (3) 



with b G [0, 1] the bias and J a positive constant. The 
connection strength for the chain Jq is a constant. The 
couphngs Cj^,,,j^ € {0,1} are random, but with the re- 
striction that every spin has degree c, or put otherwise, 
is part of c hyperedges. These couphngs are thus taken 
from the following distribution: 
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(4) 



The total number of hyperedges that a spin a is part of 
is then by definition c: 



TV ^ fo - 1)! ^ ■ ■ ■ ^ C,;ji,...j^_i 



(5) 



ji jp~i 



Since we are interested in the finitely connected case, we 
consider c to be of order 0(1), with c/N -^ 0. 

Self-interaction and hyperedges of reduced degree are 
prohibited by the following rule: 



Vk^l e {!,..., p} : jk ^ ji 



^31 ■■■■Jp 



= 0. 



(6) 



This means that when any two indices are equal the hy- 
peredge cannot exist. Also, the couplings are symmetri- 
cal: for any permutation tt in Sp we have that 



(7) 



III. SADDLE-POINT EQUATIONS 



As usual we replicate the partition function in order to 
calculate the free energy. Analytically, the calculation is 
analogous to the one found in [ll| : 



/(/3) = - hm hm log(Z")cj, (8) 



with {Z"-) given, after some algebra, by the saddle point 
equation: 



(Z"> = -^ /{dPdP} exp (iVf](P, P) 
n{P,P) - zY.PHPi'^) 



(9) 



^Ti...Tpk=l ^ 
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n (-^^('^0 



- log(c!) 



with a = 1, . . . , n the replica index. The average over J 
has to be taken according to equation ([3]), and represents 
the bond-disorder in the system. 

The next step is to take derivatives of ri(P, P) to find 
the solution of our saddle point equation. For the sake 
of brevity we first define a new variable F{cr): 



F{a) ^ c Y: lipir,){e'^^-^^-^-^^' 

Ti...Tp-i k=l 



(11) 



with which we can write the solution of the saddle point 
equation as 
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(12) 



where we have introduced the transfer matrix 



r^,x = cxpf/3Jo^(7"T"jp^H. (13) 

This equation can be simplified by introducing the left 
and right eigenvalue equations of this transfer matrix be- 
longing to the largest eigenvalue Aq: 

YTfTTui-r) = Ao7/(rT) (14) 

T 

J2vi(T)Ta,T = Ao«(t). (15) 

(T 

Inserting these properties in equation P^ leads to 



p(^) ^ EarT^r^Qrai^P) 



EaT^crcT 

E^ uia)v{tP) exp(/3Jo E„ a''i'")F'-\^) 



(16) 



Ao Eo- "('^)^'('^) 



(17) 



where QtrA'^) = e^viPJoY.c^"^'") F {^)^(t,^- I^ 
the transition to the last hne we have used the fact that 
in the thermodynamic hmit only this largest eigenvalue 
Ao contributes to the eigenvalue expansion of T^ . It is 
easy to show that this eigenvalue Aq = 1 in the limit 
n ^ (see e.g. fg). 



IV. RS ANALYSIS 

For the RS equations we assume that all the replicas of 
the system can be permuted without affecting the results. 
We make the usual assumption (see e.g. [l2]) that we can 
write the probability density P(i/') and the eigenvectors 
m(i/') and v{xjj) as 



v{ip) 



dh W{h) Jl 



^(3h^° 



(18) 



dx (f){x) lie 



J- J- 2cosh(/3/i) 

a— 1 ^ ^ 



dy x{y) n ^' 
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(20) 



where L{x, h) is given by 



L{x,h) = — atanh 
P 



tanh(/3Jo) 



(3J. 



tanh /3a; + ^ atanh(tanh(— ) J|tanh(/3/i^)) 



(24) 
The third self-consistent equation is for the density W{x). 
This can be found by using equation (|17p and filling in 
the RS ansatz for P{ip), yielding 



W{h) = 



c—l p—1 

dxdy <f>{x)x{y) n n dh^W{hf)dJP{J) 
fc=l 1=1 

h — y — -atanh (tanh (/3a;) tanh(/3Jo)) 
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— 2^ atanh tanh( — ) 1 I tanh(/3/i 



fe=i 



(25) 



Combining equations p^ and pi)) allows us to calculate 
the density (j){x) in a self-consistent way. We also take 
the limit n ^ 0, and obtain 



0(^') - I dxcj,{x)\{\{ f dKW{K) 

-' k=lv=l-' 

X f dJP{J)6[x' -R{x,h)], (21) 



with 



R{x,h) 



^ atanh tanh(^ — ) J| tanh(/3/i^) 



k=l 



-atanh {ta.nh{(3x) tanh(/3Jo)) 



(22) 



An analogous calculation leads to the self-consistent 
equation for x(a;): 

X{x') = fdxx{x)l[f[ jdhiwiK) 

•' k=lv=l-' 

X f dJP{J)6[x' -L{x,h)], (23) 



The self-consistent equations above allow us to calcu- 
late the thermodynamic properties of the system. First 
of all, we find the magnetization as: 



^^"' 



C.J 

dhW{h)ta.nh{ph). 



(26) 
(27) 



Similarly we write down the EA-parameter qaf3 (with a =/= 
/3): 



lap 



I dhW{h)tanh^{(3h) 



(28) 
(29) 



The free energy is given by: 



/3/(/3) = ^^^—^ I dJP{J) 
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with 



G«(x,/i) = J^e'3^^+''-^«^M 
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(31) 



By taking specific limits, these equations reduce to the 
self-consistent equations of other simpler systems. In the 
limit J ^ they reduce to those of an Ising chain. In the 
limits /? — » oo and Jq — > they become the equations of 
the Bethe spin-glass at zero temperature (see e.g. [l3|). 
In the latter case we notice that the distribution W{h) 
corresponds to the cavity field distribution in the graph, 
and the distribution 4){x) corresponds to the effective lo- 
cal fields. The distribution xiv) vanishes when Jq — > 0. 



V. IRSB SELF-CONSISTENT EQUATIONS 

The RS assumption causes reentrance effects, indicat- 
ing that replica symmetry is broken in certain regions of 
parameter space. As a first step to find improved results 
in this region, we can calculate the corresponding IRSB 
equations describing the model. We start from equation 
P?)) and use the IRSB form for the probability density 
P('0) and the eigenvectors ^(-0) and u(V') (see e.g. [17 



P(<t) 

u{(t) 
v{ct) 



VW ■E.[W] \\ 

7=1 ■- 



dhW{h) 



[2cosh{f3h)Y 



= E"=i' 



7=1 



r 



The objects S[VF], ri[$] and r[\E'] are distributions of 
distributions, and the integrations /^[-J must be in- 
terpreted in a distributional sense. Replicas now ac- 
quire two indices, the first one 7 = 1, . . . , ^ denoting 
to which group of replicas it belongs and the second 
one a = 1, . . . , m indicating the particular replica in the 
group. The variable m denotes the relative size of the 
group. We have to consider the limit n — > and m a 
real number, m € [0, 1]. This parameter m is not a free 
parameter, we need to use the m that extremizes the free 
energy (see e.g. [§], [l5|). 



The detailed calculation of the self-consistent equa- 
tions for these distributions can be found in the appendix 
([5]). We now have three order parameters in the sys- 
tem: the magnetization m, and two Edwards-Anderson 
parameters, go for replicas belonging to different pure 
states, and gi for replicas within a single pure state. They 
are given by 



VW E[W] I dhW{h) tanh(/3/i) 
go = fvWE[W] f dhW{h)t&nh{(3h) 
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(32) 
(33) 

.(34) The free energy is given by 



VW E[W] / dhWih) [ta.iih{f3h)Y 



/3/(/3) - 



c(1~p)t^ 



dhkWk{hk)dJPiJ) 



f[ fvWk E[Wk] log / 
mp ^J-^J y [2 cosh{f3hk)] 

I r c p-i 

- / p$ n[<i>] nil I T^Wk,, s[Wk,A log (2* ($, {M^fc..}fc..)) , 



(E exp(^/3^/.,r'^ + ^r^...^)j"' 



(35) 



with 2^$ a normalization 



/£.l^\ 



cosh(/3/i'''''^)]™ 



x|dJP(J)cxpf^^logG,(x,{/i'=^''}'=^'')j . (36) 



VI. NUMERICAL SOLUTION 

The self-consistent equations above are numerically 
solved by the technique of population dynamics (0). 
Here the different probability densities that appear 
in equations ((2T|) . ((23)) and ((25|) are represented by 
distributions of fields, and by distributions of such 
distributions in the case of the corresponding IRSB 
equations. A recursive scheme (see e.g. [9[) then allows 
these distributions to evolve towards the equilibrium 
distributions that solve the self-consistent equations. 
Monte-Carlo integration over these distributions allows 
to obtain the physical parameters. Furthermore, using 
the IRSB equations, we have to determine the m that 
extremizes f{m). 

The accuracy (and numerical cost) of the algorithm is 
mainly determined by the number of fields one chooses to 
make up the different distributions. This cannot be too 
low, since then the distributions will not be clearly out- 
lined, but it cannot be too big either, since the numerical 
cost rises linearly (in the case of RS) and quadratically 
(in the case of IRSB) with this parameter. In the RS 
algorithms we use populations of size 10^ fields, which 
results in smooth and accurate results. In the case of 
the IRSB algorithm, however, we are constrained by the 
sheer numerical cost to populations of the order of 1000 
samples (so 1000 populations of 1000 fields each). This 
will put an upper limit to the accuracy we can achieve. 



A. RS results 

We test our results against those of [1J|. To this end, 
we put the system parameters to the following values: 
The degree of the interactions p = 2, the number of con- 
nections per spin c = 6, the connection strength J — 1 
and the bias b = 0.625. We are able to fully reproduce 
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FIG. 1: The RS phase diagram for p = 3, c = 3, J=l and 
h — 0.8. The solid line depicts the ferromagnetic spinodal 
transition, and to the right of this line we can find ferromag- 
netic states, coexisting with the other solutions. The dotted 
line represents the ferromagnetic thermodynamic transition, 
where the ferromagnetic solution becomes thermodynamically 
stable. The spinglass transition line is given by the dashed 
line. The dash-dotted line indicates ergodicity breaking in the 
RS algorithm. 



the RS results presented in 1J| , although we numerically 
solved the self-consistent equations (1^ . P5|) and (P5| to 
obtain these results, as opposed to the bifurcation anal- 
ysis employed in |14| . 

We are interested in the phase diagrams for systems 
with bias and hyperspin interactions (p > 2). A typi- 
cal result can be found in Fig. [I] where we plot the full 
phase diagram for the parameters p = 3,c = 3,J = l 
and b = 0.8. The spinodal transition, in full, is of first or- 
der, which is typical for hyperspin interactions. This also 
means we will have a coexistence of solutions close to this 
transition. By comparing the corresponding free energies 
we determine the thermodynamic transition, given as a 
dotted line. The different phases and coexisting phases 
are indicated in Fig. [T] 

Furthermore, we clearly see that when the ferromag- 
netic transition lines approach the spinglass transition, a 
reentrance effect sets in, indicative of replica symmetry 
breaking. By using different initial distributions in the 
RS algorithm and comparing the final distributions for 
quenched disorder, we check whether ergodicity is bro- 




FIG. 2: The RS phase diagram for p = 3, c = 3, J = 1 
and different biases b. The solid lines represent the dynamic 
ferromagnetic transition, with from left to right: b — 1, b = 
0.9, b = 0.8 and b = 0.7. The ferromagnetic region is located 
to the right of the respective transition lines. The circles are 
the corresponding transitions obtained by simulations. See 
Fig. [T]for a further specification of the different phases. 



ken or not in the reentrance region. These points are 
indicated in Fig. [T] as a dash-dotted line that further 
illustrates the broken replica symmetry. 

Next, to check the influence of frustration on these re- 
sults, we can generate similar phase diagrams for other 
values of the bias b. The spinodal transitions are given in 
Fig. [21 with p = 3, c = 3 and several values of the bias b, 
along with Monte-Carlo simulation results. Again we flnd 
reentrance effects for the frustrated graphs, and this ef- 
fect becomes stronger when the frustration increases due 
to smaller bias b. The simulations agree with the results 
obtained by population dynamics for low frustration, but 
start to differ slightly when this frustration increases due 
to the slow dynamics of the system for these parameters. 



B. IRSB results 

Since the above results all display reentrance indicating 
RSB, we now look closer to these regions in parameter 
space employing the IRSB approach to determine pos- 
sible corrections. However, the algorithm proves to be 
very demanding numerically, and hence the results turn 
out to be rather noisy. The free energy results presented 
in this section are averages over many iterations of the 
algorithm. 

In order to see whether the IRSB approach will give 
different results in the reentrance region, we focus on a 
single point in this region on Fig. [1] the point T = 0.15 
and Jo — 0.15. The free energy as a function of the RSB 
parameter m for this point is plotted in Fig. [3l We need 
to first flnd that value of m that maximizes this free en- 
ergy, and although the results are noisy we see that this 
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FIG. 3: The IRSb free energy as function of m for T = 0.15, 
Jo = 0.15, p = 3, c = 3, J = 1 and 6 = 0.8. The maximum is 
reached around nimax ~ 0.15 
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FIG. 4: The IRSb order parameters as function of ra for 
T = 0.15, Jo = 0.15, p = 3, c = 3, J = 1 and fo = 0.8. The 
full line is the magnetization, the dashed line is go, and the 
dotted line is q\. At m-max (see Fig. 3) the magnetization 
starts to be nonzero, indicating a ferromagnetic phase. 



parameters of the system are plotted as function of m in 
Fig. m and we see that at m-max the magnetization is 
nonzero, indicating that this point is located inside the 
ferromagnetic region, as opposed to the RS spinglass re- 
sult. However, because of the noise in the system and the 
sharp transition from a spinglass solution to a ferromag- 
netic solution in the neighborhood of 7Ti,„ax, it is hard to 
present quantitative results with the IRSB approach. We 
did find a qualitative indication that the IRSB method 
will at least decrease the reentrance region in the phase 
diagram. Creating a IRSB phase transition line between 
the ferromagnetic and spinglass phase is unfortunately 
beyond our present computational capabilities, and we 



will not pursue this goal in this paper. 

We have also calculated the limits of the IRSB equa- 
tions for T ^ and Jq -^ 0. The results obtained are 
in agreement with those presented in 13]. The noise in 
the system seems to decrease significantly in this limiting 
case, and we conclude that the major source of the noise 
in the algorithm is the interaction between the ferromag- 
netic ring and the bond-disordered random hypergraph. 
When the ring is not present, we are left with only a sin- 
gle density, and the algorithm functions much better for 
the relatively small system sizes we employ. 



VII. CONCLUSIONS 

In this paper, we have studied the thermodynamic 
properties of a Bethe lattice with p-spin interactions aug- 
mented with a one-dimensional ferromagnetic chain in- 
terconnecting all spins. We have calculated the RS and 
IRSB self-consistent equations describing the order pa- 
rameters and the free energy. By employing population 



J 



dynamics we have been able to solve these self-consistent 
equations and to obtain the phase diagrams of the system 
as function of the different system parameters. We have 
noticed reentrance effects in the RS phase diagrams, in- 
creasing with the bond-disorder in the system, indicating 
RSB. The IRSB algorithm indicates that this reentrance 
region will decrease when replica symmetry breaking is 
taken into account. The algorithm is quite noisy how- 
ever, preventing us from giving precise quantitative re- 
sults. By both the analytic analysis and the numerical 
results using the corresponding algorithms at tempera- 
ture zero and zero chain interaction, we observe a sub- 
stantial decrease in the noise on the results. This leads 
us to believe that the ferromagnetic chain is the major 
factor causing the noise in the IRSB algorithm. 
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APPENDIX A: CALCULATION OF THE SELF-CONSISTENT EQUATIONS 



To calculate the IRSB self-consistent equations for the distributions S[l/l^], ^[<&] and r[vE'], we start with the 
eigenvector equation of the transfer matrix T (|14p . and fill in the IRSB assumption concerning the different matrices 
and vectors (1321) and (l33l): 



y^ Tct,tu{t) = ^ exp /3 Jo ^ OaT, 



u{t) 



l...TP-lfe=l 

E / ^* ^[*] n / dx^^{x^) exp I3x^ E ^".7 + /^-^o E E ^",7^", 

T '' 7=1 V a=l 7 a 

X exp f — E E ^":7 • ■ ■ ^s:;^cr".7 J ■ 






(Al) 



We put all the exponentials together 



F^-- {x^,{h';'''}''^'') 



22 exp {f3x^T + pJoaa,yT) j 



p-i 



n E n ^-p ( /3/^^"- 



\v^k,v I P'-' ^1. 



V ^p-l,v 



(A2) 



and use the identity 



n^." 



expf^logF;"-j 

exp (j2 ^c., (^ E - log ^; ) + - E ( ^ E i°g ^7^ 



(A3) 



to obtain 






7=1 



i/=l fc=l 



nexp(E^«.7(^E^l°g^7K.{/^7''^}''''))+"^(^El°g^7M^7,{/^7''}''^^ 
7\Q:\cr /\cr 



We now employ the fact that 



2/3 



(A4) 
(A5) 



^ atanh I tanh( — ) J| tanh(^/i^^'') j + atanh (tanh(/3a;'^) tanh(/? Jo)) 



fc=i 



and write the expression (IA1|) as a functional integral over a delta function. This leads to 

c p— 1 



Y,Ta.Tu{T) = Jv^' Jv<^nm flYlfvWk^,E[Wk,A 



xSpi $'(x')- 



iv=l fe=l ' 



-pj- W d/i'=''^PFfc,.(/i'=''^) /^m 



2$ ($, {W^fe,.}fc,.) 7 ^^^^11 [2cosh(/3/i'=.-)] 



exp('|^logJ^-(x,{/.'^-}'^-)') 



x6{x'-R{x\{h';^''}''n) 



{Z^{^,{Wk^,}k,u))^f[ /"dz$'(z)exp(/3z^a„ 

7 = 1'^ V a 



The functional 2^$ is a normalization factor given by 



Z, ($, {H^,,.}.,.) . / dxHx) J n n [2tS;f.)]2 exp {j E log ^^ (-' i'^'^^^l'^'l) 



(A6) 



(A7) 



We now identify this with (|34|) to find the self-consistent equation for the functional distribution r2[$]. We also take 
the limit n ^ 0. 

c p-1 

(A8) 

i/=l/c=l' 



^ , 1 f 1 -^ 

da;$(x) 



x5i. $'(x') 



n n iSSsS- f ? E.o.^' (- 1'.-)-)! (AS) 



2$ (*, {VKfc,,}fc,,) J AJ-^ J-^^ [2 cosh(/3/i'=.-)]™ ^ \^ 2 
x,^(x'-i?(:EM/i^^''}^-''^)) J 

A similar calculation yields analogous equations for the two other distributions il[$] and r[^]. 
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